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(54) Hierarchical segmentation of digital image using wavelet decomposition and contour 
projection 



(57) The invention concerns a method of analysing 
a set of data representing physical quantities, including 
the steps of: 

decomposition (E20) of the set of data on a plurality 
of resolution levels, 

first segmentation (E21 ) of at least one sub-part of 
a given resolution level, into at least two homoge- 
neous regions, said given resolution level not being 
the highest resolution level in the decomposition, 

characterised in that it includes the steps of: 

extraction (E81) of contour data from the result of 
the segmentation of the previous step, 
second segmentation (E25) of at least one sub-part 
of the resolution level higher than the given level 
into at least one homogeneous region, as a function 
of the contour data extracted. 
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Description 

[0001] The preser. .nvention concerns in general 
terms the analysis cf a digital signal and proposes for 
this purpose a device and method for analysing a digital 
signal by decomposition into a plurality of resolution lev- 
els, and segmentation. 

[0002] The purpose of the analysis is to provide a hi- 
erarchical segmentation of the signal, thus make it pos- 
sible to access the objects or regions present in an im- 
age, at several resolution levels, with several possible 
levels of detail. Access to the objects of an image can 
be used for different purposes: 

- selective coding of the objects of the image, grant- 
ing a higher coding quality to the -important" objects 
in the image, 

progressive transmission of the data of the image, 
with transmission ol the more important objects be- 
fore the others, 

extraction of a particular object from the image, with 
a view to its manipulation, transmission, coding, 
and storage. 

[0003] The present invention is more particularly ap- 
plicable to the analysis of a digital signal. Hereinafter, 
the concern will more particularly be with the analysis of 
digital images or video sequences. A video sequence is 
defined as a succession of digital images. 
[0004] There exist several known ways of effecting 
the decomposition of a signal on several resolution lev- 
els: it is for example possible to use Gaussian/Laplacian 
pyramids, or to decompose the signal into frequency 
sub-bands at several resolution levels. 
[0005] The remainder of this description will be con- 
cerned with the second case, but it is important to note 
that the present invention applies to all known multi-res- 
olution decompositions. 

[0006] In the particular case of a decomposition into 
frequency sub-bands, the decomposition consists of 
creating, from the digital signal, a set of sub-bands each 
containing a limited frequency spectrum. The sub- 
bands can be of difference resolutions, the resolution of 
a sub-band being the number of samples per unit length 
used for representing this sub-band. In the case of an 
image digital signal, a frequency sub-band of this signal 
can be considered to be an image, thai is to say a bi- 
dimensional array of digital values. 
[0007] The decomposition of a signal into frequency 
sub-bands makes it possible to decorrelate the signals 
so as to eliminate the redundancy existing in the digital 
image prior to the compression proper. The sub-bands 
can then be compressed more effectively than the orig- 
inal signal. Moreover, the low sub-band of such a de- 
composition is a faithful reproduction, at a lower resolu- 
tion, of the original image. It is therefore particularly well 
suited to segmentation. 

[0008] The segmentation of a digital image will make 



it possible to effect a partitioning of the image into ho- 
mogeneous regions which do not overlap. In this con- 
text, the image is considered to consist of objects with 
two dimensions. The segmentation is a low-level proc- 
5 ess whose purpose, is to effect a partitioning of the image 
into a certain number of sub-elements called regions. 
The partitioning is such that the regions are disconnect- 
ed and their joining constitutes the image. The regions 
correspond or do not correspond to objects in the image, 
10 the term objects referring to information of a semantic 
nature. Very often, however, an object corresponds to a 
region or set of regions. Each region can be represented 
by information representing its shape, colour or texture. 
The homogeneity of the region of course depends on a 
>5 particular criteria of homogeneity; proximity of the aver- 
age values or preservation of the contrast or colour, for 
example. 

[0009] Object means an entity of the image corre- 
sponding to a semantic unit, for example the face of a 
& person. An object can consist of one or more regions 
contained in the image. Hereinafter the term object or 
region will be used indifferently. 
[0010] Conventionally, the segmentation of the digital 
image is effected on a single resolution level, which is 
25 the resolution of the image itself. Conventionally, the 
segmentation methods include a first step known as 
marking, that is to say the interior of the regions housing 
a local homogeneity is extracted from the image. Next 
a decision step precisely defines the contours of the ar- 
30 eas containing homogeneous data. At the end of this 
step, each pixel of the image is associated with a label 
identifying the region to which it belongs. The set of all 
of the labels of all the pixels is called a segmentation 
map. 

35 [0011] This type of segmentation makes it possible to 
obtain a relatively effective segmentation of the image 
but has the drawbacks of being slow and not very robust 
and presenting all the objects at the same resolution. 
[0012] This is the case for example with the so called 
-*o MPEG4 standard (from the English "Motion Picture Ex- 
pertGroup"), for which an ISO/I EC standard is currently 
being produced. In the MPEG4 coder, and more partic- 
ularly in the case of the coding of fixed images, the de- 
composition of the image into frequency sub-bands is 
^5 used conjointly with a segmentation of the image. A step 
prior to coding (not standardised) is responsible for iso- 
lating the objects of the image (video objects) and rep- 
resenting each of the these objects by a mask. In the 
case of a binary mask, the spatial support of the mask 
50 has the same size as the original image and a point on 
the mask at the value 1 (or respectively 0) indicates that 
the pixel at the same position in the image belongs to 
the object (or respectively is outside the object). 
[0013] For each object, the mask is then transmitted 
55 to a shape decoder whilst the texture for each object is 
decomposed into sub-bands, and the sub-bands are 
then transmitted to a texture decoder. 
[0014] This method has a certain number of draw- 
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backs. This is because the object is accessible only at 
its highest resolution level, there is no progrcssivity in 
segmentation. Moreover, the number of objects manip- 
ulated is a priori the same at all levels, whilst it may be 
more advantageous to have a number of objects in- 
creasing with the (spatial) resolution that is to say a true 
conjoint scalability between the resolution and the 
number of objects. 

[0015] The article "Multiresolution adaptative image 
segmentation based on global and local statistics" by 
Boukerroui. Basset and Baskurt. which appeared in 
IEEE International Conference on Image Processing 
24-28 October 1 999. vol. 1 pages 358 to 361 . describes 
a hierarchical segmentation based on a multiresolution 
pyramid of an image, etlectcd by discrete wavelet trans- 
form, known as DWT. 

[0016] In addition, the article "Multiresolution image 
segmentation for region-based motion estimation ana 
compensation - by Salgado. Garcia. Mencndc/ and 
Rendon. which appeared in IEEE International ComUm 
ence on Image Processing. 24-28 October 1999 vol 2 
pages 135 to 139. describes a hierarchical segmenta- 
tion also based on a multiresolution pyramid of an im 
age. A partitioning of the image effected at the lowest 
resolution level is projected onto the higher resolution 
levels. 

[0017] However, none of these known methods pro- 
vides access to the region or objects with different res- 
olution levels, in a consistent and coherent manner Co- 
herent means here that an object at a given resolution 
level always descends from a single object with a lower 
resolution (parent), and gives rise to at least one object 
at the higher resolution level (child or children). 
[0018] The present invention aims to remedy the 
drawbacks of the prior article by providing a method and 
device for the hierarchical segmentation of a digital sig- 
nal which offers access to the regions or objects at dif- 
ferent resolution levels, in a consistent and coherent 
manner. 

[0019] In this context, the invention concerns a meth- 
od of analysing a set of data representing physical quan- 
tities, including the steps of: 

decomposition of the set of data on a plurality of res- 
olution levels, 

segmentation of at least a sub-part of a given res- 
olution level, into at least two homogeneous re- 
gions, said given resolution level not being the high- 
est resolution level in the decomposition. 

characterised in that it includes the steps of: 
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[0020] More particularly, the invention proposes a 
method of analysing a set of data representing physical 
quantities, including the steps of: 

5 - decomposition of the set of data on a plurality of res- 
olution levels, 

first segmentation of at least one sub-part of a given 
resolution level, into at least two homogeneous re- 
gions, said given resolution level not being the high- 
10 est resolution level in the decomposition, 

characterised in that it. includes the steps of: 

extraction of contour data from the result of the seg- 
mentation of the previous step, 
. - second segmentation of at least one sub-part of the 
resolution level higher than the given level into at 
least one homogeneous region, as a function of the 
contour data extracted. 

[0021] Correlatively, the invention proposes a device 
for analysing a set of data representing physical quan- 
ti:ics- having: 

- moans of decomposing the set of data on a plurality 
of resolution levels, 

means for the first segmentation of at least one sub- 
part of a given resolution level, into at least two ho- 
mogeneous regions, said given resolution level not 
oeing the highest resolution level in the decompo- 
sition. 

characterised in that it has: 

J* - means of extracting contour data from the result of 
the segmentation of the previous step, 
means for the second segmentation of at least one 
sub-part of the resolution level higher than the given 
resolution level into at least one homogeneous re- 
gion. as a function of the extracted contour data. 

[0022] By virtue of the invention, the segmentation is 
conercnt. or continuous: an object with a given' resolu- 
tion level always descends from a single object with a 
lower resolution level (parent), and gives rise to at least 
one object at the higher resolution level (a child or chil- 
Uicn) 

[0023] In addition, there is a hierarchical segmenta- 
tion ;at several resolution levels). The advantages of hi- 
crarchical segmentation are many: 

progressive object-based coding and transmission 
can be effective at several resolution levels, 
it is possible to segment the image according to fin- 
er and finer details or objects on progressing 
through the resolution levels; the user can thus ac- 
cess tne objects of the image with a more or less 
groat level of detail. For example, at a lower reso- 



storage of information representing at least part of 
the result of the segmentation of the previous step, 
segmentation of at least one sub-part of the higher 
resolution level into at least one homogeneous re- 
gion, according to the information stored. 
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lution, the user often needs only a.coarse segmen- 
tation (the chest and face of a person), whilst he 
would wish to access a higher level of detail when 
the resolution increases (eyes, nose, mouth on the 
face, etc), 

- the robustness of the global segmentation and the 
speed of segmentation are generally higher in the 
case of a hierarchical segmentation than in the case 
of a segmentation at a single level. 

[0024] According to a preferred characteristic, the de- 
composition is at each resolution level a decomposition 
into a plurality of frequency sub-bands. This type of de- 
composition is normally used in image processing, and 
is simple and rapid to implement. 
[0025] According to another preferred characteristic 
the first segmentation is effected on a low-frequency 
sub-band of the given resolution level. This is because 
the lower-frequency sub-band forms a "simplified" ver- 
sion of the signal, and it is consequently advantageous 
to effect the segmentation on this sub-band. 
[0026] According to preferred characteristics, the giv- 
en resolution level is the lowest resolution level, and the 
extraction and second segmentation stops arc effective 
iteratively as far as the highest resolution level. Thus a 
hierarchical segmentation is obtained on all the resolu- 
tion levels. 

[0027] According to a preferred characteristic, the 
second segmentation includes: 



[0031] The invention also concerns a digital appara- 
tus including the analysis device, or means of imple- 
menting the analysis method. The advantages of the de- 
vice and digital apparatus are identical to those di*- 
5 closed above. 

[0032] The invention also concerns an information 
storage means, which can be read by a computer or mi- 
croprocessor, integrated or not integrated into the de- 
vice : possibly removable, storing a program implement - 
10 ing the analysis method. . 

[0033] The characteristics and advantages of the 
present invention will emerge more clearly from a read- 
ing of a preferred embodiment illustrated by the accom- 
panying drawings, in which: 



- a projection of a contour image resulting from the 
first segmentation, on said at least one sub-part of 
the higher resolution level which is to be segment- 
ed, 

- a marking of the coefficients of said at least one sub- 
part of the higher resolution level, as a function of 
the result of the projection, and 

a decision. 

[0028] According to another preferred characteristic 
the second segmentation is effected on a lower-fre- 
quency sub-band of the higher resolution level. As with 
the first segmentation, it is advantageous to effect the 
second segmentation on a "simplified" version of the 
signal. 

[0029] According to a preferred characteristic the 
contour data extraction includes, for each coefficient of 
the segmented sub-part: 

- a comparison of said coefficient with its neighbours, 

- setting of a contour coefficient corresponding to 
said coefficient to a first predetermined value if the 
coefficient is different from at least one of its neigh- 
bours, or to a second predetermined value if the co- 
efficient is similar to all its neighbours. 

[0030] The device has means adapted to implement 
the above characteristics. 



- Figure 1 is an embodiment of a device implement- 
ing the invention, 

• Figure 2 depicts an analysis algorithm according to 
the present invention, 
20 - Figure 3 is an algorithm for implementing the non- 
assisted segmentation step included in the analysis 
algorithm of Figure 2, 

- Figure 4 is an algorithm for implementing the assist- 
ed segmentation step included in the analysis algo- 
us rithm of Figure 2, 

- Figure 5 is an algorithm showing the assisted seg- 
mentation steps according to the present invention, 

- Figure 6 is a block diagram of a device implement- 
ing the invention, 

30 - Figure 7 is a circuit for decomposition into frequency 
sub-bands included in the device of Figure 6. 

- Figure 8 is a digital image to be analysed according 
to the present invention, 

- Figure 9 is an image decomposed into sub-bands 
55 according to the present invention. 

[0034] According to the chosen embodiment depicted 
m Figure 1, a device implementing the invention is for 
example a microcomputer connected to different periph- 

™ erals, for example a digital camera 107 (or a scanner, 
or any image acquisition or storage means) connected 
to a graphics card and supplying information to be ana- 
lysed according to the invention. 
[0035] The device 1 0 has a communicating interface 

45 112 connected to a network 113 able to transmit digital 
data to be analysed or conversely to transmit data ana- 
lysed by the device. The device 10 also has a storage 
means 1 08 such as for example a hard disk. It also has 
a drive 109 for a disk 110. This disk 110 can be a dis- 

so kette, a CD-ROM or a DVD-ROM for example. This disk 
110, like the disk 108, can contain data processed ac- 
cording to the invention as well as the program or pro- 
grammes implementing the invention which, once read 
by the device 10, will be stored in the hard disk 108 

55 According to a variant, the program enabling the device 
to implement the invention can be stored in read only 
memory 102 (referred to as ROM in the drawing) In a 
second variant, the program can be received in order to 
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be stored in an identical fashion to that described pre- 
viously by means of the communication network 113. 
[0036] The device 10 is connected to a microphone 
111. The data to be processed according to the invention 
will in this case be of the audio signal. 
[0037] This same device has a screen 1 04 for display- 
ing the data to be analysed or transmitted or serving as 
an interface with the user, who will be able to parame- 
terise certain analysis modes, using the keyboard 114 
or any other means (mouse for example). 
[0038] The central unit 1 00 (referred to as CPU in the 
drawing) executes the instructions relating to the imple- 
mentation of the invention, instructions stored in the 
read only memory 1 02 or in the oihcr storage elements. 
On powering up, the analysis program stored in a non- 
volatile memory, for example the HOtJ 102. arc trans- 
ferred into the random access memory RAM 103 which 
would then contain the executable code of the invention 
as well as registers for storing the variables necessary 
for implementing the invention. 

[0039] In more general terms, an information storage 
means, which can be read by a computer or microproc- 
essor, integrated or not into the device possibly 'cmov 
able, stores a program for implementing the met hoc ac 
cording to the invention. 

[0040] The communication bus 101 affords commu- 
nication between the different elements included in the 
microcomputer 1 0 orconnected to it The representation 
of the bus 101 is not limitative and notabe no central 
unit 100 is able to communicate instructions to any cle- 
ment of the microcomputer 1 0 directly or by means of 
another element of the microcomputer 10 
[0041] With reference to Figure 2 an embodiment of 
the method of analysing according to the invention an 
image IM includes steps E20 to E27 which arc run 
through by the central unit of the device 10 described 
above. The method includes overall the decomposition 
of the image on a plurality of resolution levels then the 
segmentation of at least a sub-part of a given resolution 
level, into at least two homogeneous regions the said 
given resolution level not being the highest resolution 
level in the decomposition, followed by the storage of 
information representing at least part of the result of the 
segmentation of the previous step and tinally the seg- 
mentation of at least a sub-pan of the higher resolution 
level into at least one homogeneous region, according 
to the information stored. 

[0042] More precisely, the invention includes the ex- 
traction of contour data from the result of the segmen- 
tation of the previous step, and the segmentation of at 
least a sub-part of the higher resolution level into at least 
one homogeneous region, according to the contour data 
extracted. 

[0043] Step E20 is the decomposition of the image IM 
into a plurality of resolution levels and more particularly 
into a plurality of frequency sub-bands with different res- 
olutions, as will be detailed below with reference to Fig- 
ure 9. For example, the decomposition is effected on 



three resolution levels thus supplying sub-bands LL 3 , 
HL 3 LH 3 and HH 3 with the lowest resolution RES 3 , the 
sub-bands HL 2 . LH 2 and HH 2 of the intermediate reso- 
lution level RES 2 , and the sub-bands HL 1 , LH 1 and HH 1 

5 of the highest resolution RES V It should be noted that, 
during this step, all the sub-bands LL n , HL n , LH n and 
HH n of a resolution level RES n , where n is an integer, 
can be stored, or the lower-frequency sub-band LL n can 
be stored only for the lowest resolution level, and syn- 

io thesised for the other levels. 

[0044] The following step E21 consists of segmenting 
the low sub-band LL N in order to supply a segmentation 
of level N, N being an integer equal for example to 3 if 
3 decomposition levels are effected; the low sub-band 

75 LL N is the sub-band LL 3 in our example. The result of 
the segmentation is a segmentation S N containing at 
least two distinct regions covering all the segmented 
sub-band. This segmentation step is detailed below with 
reference to Figure 3. 

20 [0045] During the following step E22, a parameter i is 
initialised to the value 0. The parameter i indicates the 
current resolution level N-i, where N corresponds to the 
total number of decomposition levels, here 3. This indi- 
cator will be subsequently updated at each iteration. 

25 [0046] Step E22 is followed by E23, during which at 
least one region of the segmentation of resolution level 
N-i is stored in order to be used subsequently during the 
segmentation step of the immediately higher resolution 
level. 

x> [0047] Step E23 is followed by E24 which, where the 
low sub-bands LL n have not been stored, effects a syn- 
thesis on the sub-bands of the resolution level N-i in 
question. The result of the synthesis step is a recon- 
structed low sub-band LLS N . M , of resolution immediate- 

35 iy higher than the sub-bands which were used for syn- 
thesis. Thus, from the sub-bands LL 3 , LH 3 , HL 3 and HH 3 
a low sub-band LLS 2 of level 2 is reconstructed. Natu- 
rally this step is replaced by a simple reading in memory 
of the higher resolution level in the case where all the 

-io sub-bands have been stored during the decomposition. 
[0048] During step E25, there is effected a second 
segmentation of at least one sub-part of the reconstruct- 
ed level and more precisely of the sub-^band l-LS^.., ob- 
tained during step E24. This so-called assisted second 
segmentation uses two sources as a input: the informa- 
tion stored at step E23, and the current low sub-band 
LLS N . M . The purpose of this assisted segmentation 
step is to provide a segmentation at the current resolu- 
tion level N-i-1, coherent with the previous resolution 

50 level N-i. 

[0049] Coherent means that the segmentation is con- 
tinuous, that is to say a region or even an object can be 
followed from one level to the other. In particular, this 
coherence implies that an object of level N-i always ex- 
55 ists at level N-i-1 , and descends from at least one parent 
object of level N-i+1 , if this level exists; during passage 
to the level N-i-1 of higher resolution, the object of res- 
olution N-i can have been sub-divided into several ob- 
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spect the. regions which have been established at the 
previous segmentation step at the lower resolution level 
and thus continuity (coherence) of the hierarchical seg- 
mentation is ensured. 

[0070] Step E100 is an initiation of scanning of the 
sub-band. During the running of the algorithm, the sub- 
band is scanned in its entirety (for example from top to 
bottom and right to left). At this step a first coefficient of 
the sub-band is considered. 

[0071] At the following step E101 a new kernel is 
sought. For the first passage, the first coefficient of the 
sub-band is considered to be a kernel. 
[0072] If a kernel is found, step E 101 is followed by 
step E102. which is an initialisation for creating a region 
to which a characteristic is allocated I he charactenstic 
is for example the mean value ol the coeiircients ol the 
region. At this step ; the charactensic is the value ol the 
kernel found at the previous step 
[0073] Step E103 considers a variable referred to as 
the current point and associates it with the kernel found 
at step E 1 01 . This current point will be tic var^oic used 
in the loop of seeking points sim.lar to :hc region 
[0074] A neighbour of the current pom is read at stop 
E104. K 

[0075] The following step E105 is a comparison of the 
current neighbour with the charactonstcs d! t-> 0 current 
region and verification in the comou .mage .f tnc label 
of this neighbour in the image of ino comers is a, the 
predetermined value corresponding to a rog.on 
[0076] In the affirmative, step E 105 is followed oy step 
E106, at which this point is allocated to the curren: re- 
gion and the characteristics of the region are recalculat- 
ed taking account of this point. 
[0077] If the response is negative ai step E1D5 the 
neighbour is for example close to the characteristics of 
the region but its label in the image of the contours is 
not at the predetermined value corrcsponcmg to any re- 
gion. This means that this point formed part ol a contour 
during the segmentation of the previous level and is con- 
sequently rejected. Step E105 is then 'oiiowcd by step 
E 1 08, just as step E1 06 is followed by step E 1 08 
[0078] Step E108 consists of checking whether the 
current neighbour is the last neighbour II the response 
is negative, step E108 is followed by the previously de- 
scribed step E104. 

[0079] If the response is positive at sicp E108 all the 
neighbours of the current point have been run through 
and step E108 is followed by step E109 which is a test 
for checking whether there remains at least one coeffi- 
cient of the region to be processed. A non-processed 
point is a neighbour which has been retained in the re 
gion, but whose own neighbours have not been exam 
ined. 

[0080] If the response is positive at step E 1 09 the lat- 
ter is followed by step E110, which is the reading of an 
unprocessed coefficient and which allocates its value to 
the current point variable. Step E110 is followed by the 
previously described step E1 04. 



[0081] If the response is negative at step E1 09 all the 
region has been scanned, and step E109 is followed by 
step El 01 in order to seek another. kernel. 
[0082] If this search is fruitless (all the points of the 
* sub-bands have been examined), step E101 is followed 
by step E111 , which checks whether the previously de- 
termined regions are too small. The minimum size of the 
regions is generally a parameter of the segmentation al- 
gonthm. In the affirmative, the regions concerned will be 
to eliminated at step E1 12. 

[0083] Steps E111 and E112 are followed by the pre- 
viously described step. E84. 

[0084] In accordance with Figure 6, the analysis de- 
vice according to the invention has- 

15 

- means of decomposing all the data on a plurality of 
resolution levels, 

- means of first segmentation of at least one sub-pan 
of a given resolution level, into at least two homo- 
geneous regions, said given resolution level not be- 
ing the highest resolution level in the decomposi- 
tion, 

means of extracting contour data from the result of 
the segmentation of the previous step, 
means of second segmentation of at least one sub- 
part of the resolution level higher than the given lev- 
el into at least one homogeneous region, according 
to the extracted contour data. 
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20 [0085] One embodiment of the device according to 
the invention has a signal source 30. here for an image 
signal IM. whether it is a fixed image or an image se- 
quence. In general terms, the signal source either con- 
tains the digital signal, and has for example a memory 
* a hard disk or a CD-ROM, or converts an analogue sig- 
nal into a digital signal, and is for example an analogue 
camcorder associated with an analogue to digital con- 
verter. The image source 30 generates a series of digital 
samples representing an image IM. The image signal 
IM is a series of digital words, for example bytes Each 
byte value represents a pixel of the image IM, here with 
256 levels of grey or in colour. 

[0086] An output of the signal source 30 is connected 
to a circuit 60 for decomposing the image IM into fre- 
" quency sub-bands, as will be detailed hereinafter with 
reference to Figure 7. For example, the decomposition 
will be carried out on three resolution levels thus sup- 
plying sub-bands LL 3 , HL 3 , LH 3 and HH 3 of the lowest 
resolution level RES 3 , the sub-bands HL 2 . LH 2 and HH, 
so at intermediate resolution RES 2 , and the sub-bands 
HL V LH, and HH, of the highest resolution RES 1 It 
should be noted that, during this operation, the sub- 
bands are stored in whole or in part. 
[0087] The circuit 60 is connected to a circuit 61 for 
55 segmenting the low sub-band of the current resolution 
level. The circuit 61 supplies a segmentation map of the 
current level. The low sub-band is question is the sub- 
band LL 3 during the first passage, otherwise it is a case 
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either of the low sub-band synthesised by, the recon- 
struction synthesis unit 64, or the sub-band of higher 
level if this was stored at the time of decomposition. With 
this segmentation effected, at least some of the infor- 
mation obtained by the segmentation is supplied to a 
storage circuit 62 which stores this information. 
[0088] The segmentation circuit makes it possible to 
extract contour data by means of the following opera- 
tions which are performed for each coefficient of the 
segmented sub-band: 

comparison of said coefficient with its neighbours, 
setting a contour coefficient corresponding to said 
coefficient to a first predetermined value if the coef- 
ficient is different from at least one of its neighbours, 
or to a second predetermined value if the coefficient 
is similar to all its neighbours. 

[0089] The circuit 62 is connected to an assisted seg- 
mentation circuit 63. The assisted segmentation circuit 
segments the low sub-band of high resolution level with 
the information previously stored by the circuit 62. 
[0090] The assisted segmentation circuit is adapted 
to perform: 

a projection of a contour image resulting from the 
first segmentation, onto the low sub-band of the 
higher resolution level which is to be segmented, 
a marking of the coefficients of said low sub-band 
of the higher resolution level, according to the result 
of the projection, and 
a decision. 

[0091] If all the sub-bands were stored at the time of 
decomposition, the segmentation circuit 63 reads the 
low sub-band of higher resolution stored in memory 62, 
otherwise the reconstruction circuit 64 reconstructs, us- 
ing the current sub-band and the other sub-bands of cur- 
rent resolution level, a low sub-band of higher resolu- 
tion, which is used by the circuit 63. 
[0092] The circuit 63 supplies as an output a hierar- 
chical segmentation of the image IM. 
[0093] According to Figure 7, the circuit 60 has three 
successive analysis units for decomposing the image 
IM into sub-bands according to three resolution levels. 
[0094] In general terms, the resolution of a signal is 
the number of samples per unit length used for repre- 
senting this signal. In the case of an image signal, the 
resolution of a sub-band is related to the n umber of sam- 
ples per unit length for representing this sub-band. The 
resolution depends notably on the number of decima- 
tions performed. 

[0095] The first analysis unit receives the digital im- 
age signal and applies it to two digital f ilters, respectively 
low pass and high pass 601 and 602, which filter the 
image signal in a first direction, for example horizontal 
in the case of an image signal. After passing through 
decimators by two:6100:and 6200, the resulting filtered 



signals are respectively applied to two filters, low pass 
603 and 605, and high pass 604 and 606, which filter 
them in a second direction, for example vertical in the 
case of an image signal. Each resulting filtered signal 

5 passes through a respective decimator by two 6300, 
6400, 6500 and 6600. The first unit delivers as an output 
four sub-bands LL,, LH V HL, and HH, of the highest 
resolution RES^ in the decomposition. 
[0096] The sub-band LL1 includes the components, 

10 or coefficients, of low frequency, in both directions, of 
the image signal. The sub-band LH 1 includes the com- 
ponents of low frequency in the first direction and of high 
frequency in a second direction , of the image signal . The 
sub-band HL, includes the components of high frequen- 

*5 cy in the first direction and the components of low fre- 
quency in the second direction. Finally the sub-band 
includes the components of high frequency in both 
directions. 

[0097] Each sub-band is an image constructed from 
20 the original image, which contains information corre- 
sponding to a respectively vertical, horizontal and diag- 
onal orientation of the image, in a given frequency band. 
[0098] The sub-band LL 1 is analysed by an analysis 
unit similar to the previous one for supplying four sub- 
25 bands LL 2 , LH 2 , HL 2 and HH 2 of resolution level RES2 
intermediate in the decomposition. The sub-band LL 2 
includes the components of low frequency in the two 
analysis directions, and is in its turn analysed by the third 
analysis unit similar to the two previous ones. The third 
30 analysis unit supplies sub-bands LL 3 , LH 3 , HL 3 and 
HH 3 . of lowest resolution level RES 3 in the decomposi- 
tion, resulting from the division.of the sub-band LL 2 into 
sub-bands. 

' [0099] Each of the sub-bands of resolution RES 2 and 

35 RES 3 also corresponds to an orientation in the image. 
[0100] The decomposition effected by the circuit 60 is 
such that a sub-band of a given resolution is divided into 
four sub-bands of lower resolution and therefore has 
four times more coefficients than each of the sub-bands 

*o of lower resolution. 

[0101] A digital image IM output from the image 
source 30 is depicted schematically in Figure 8, whilst 
Figure 9 depicts the image IMD resulting from the de- 
composition of the image IM, into ten sub-bands accord- 

^5 jng to three resolution levels : by the circuit 60. The im- 
age IMD contains as much information as the original 
image IM , but the information is divided in frequency ac- 
cording to three resolution levels. 
[0102] The lowest resolution level RES 3 contains the 

so sub-bands LL 3 , HL 3 , LH 3 and HH 3 , that is to say the sub- 
bands of low frequency in the two analysis directions. 
The second resolution level RES 2 includes the sub- 
bands HL 2 , LH 2 and HH 2 and the highest resolution level 
RES 1 includes the sub-bands of higher frequency HL,, 

55 LH 1 and HH V 

[0103] The sub-band LL3 of lowest frequency is a re- 
duction of the original image. The other sub-bands are 
detail sub-bands. 
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T0104J Naturally, the number of resolution levels and 
consequently of sub-bands, can be chosen differently, 
for example 1 3 sub-bands and four resolution levels, for 
a bi-dimensional signal such as an image. The number 
of sub-bands per resolution level can also be different. 
The analysis and synthesis circuits are adapted to the 
dimension of the signal being processed. 
[0105] Naturally, the present invention is in no way 
limited to the embodiments described and depicted, but 
quite the contrary encompasses any variant within the 
capability of an expert. 
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Claims 

1. Method of analysing a set of data representing 
physical quantities, including the steps of: 

■ decomposition (E20) of the set or data on a plu- 
rality of resolution levels, 

- first segmentation (E21 ) of at least one sub-part 
of a given resolution level, into at least two ho- 
mogeneous regions, said given resolution level 
not being the highest resolution level in the de- 
composition, 

characterised in that it includes the steps of: 

- extraction (E81 ) of contour data from the result 
of the segmentation of the previous step, 

- second segmentation (E25) of at least one sub- 
part of the resolution level higher than the given 
level into at least one homogeneous region, as 
a function of the contour data extracted. 
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25 



30 



35 



40 



4. 



45 



Analysis method according to Claim 1 , character- 
ised in that the decomposition (E20) is at each res- 
olution level a decomposition into a plurality of fre- 
quency sub-bands. 

Analysis method according to Claim 2. character- 
ised in that the first segmentation (E21 ) is effected 
on a low-frequency sub-band of the given resolution 
level. 

Analysis method according to any one of Claims 1 
to 3, characterised in that the given resolution level 
is the lowest resolution level. 

Analysis method according to any one of Claims 1 
to 4, characterised in that the extraction and second 
segmentation stops (E25) arc effected itcrativcly as 
far as the highest resolution level. 

Analysis method according to any one of Claims 1 55 
to 5 : characterised in that the second segmentation 
step includes: 



50 



- a projection (E82) of a contour image resulting 
from the first segmentation, on said at least one 
sub-pan of the-higher resolution level which is 
to be segmented. 

- a marking (E83) of the coefficients of said at 
least one sub-part of the higher resolution level, 
as a function of the result of the projection, and 

- a decision (E84). 

Analysis method according to any one of Claims 2 
to 6, characterised in that the second segmentation 
(E25) is effected on a low-frequency sub-band of 
the higher resolution level. 

Analysis method according to any one of Claims 1 
to 7, characterised in that the contour data extrac- 
tion (E81 ) includes, for each coefficient of the seg- 
mented sub-part: 

■ the comparison of said coefficient with its 
neighbours, 

- setting of a contour coefficient corresponding 
to said coefficient to a first predetermined value 
if the coefficient is different from at least one of 
its neighbours, or to a second predetermined 
value if the coefficient is similar to all its neigh- 
bours. 

Device for analysing a set of data representing 
physical quantities, having: 

- means of decomposing (60) the set of data on 
a plurality of resolution levels, 

- means (61 ) for the first segmentation of at least 
one sub-part of a given resolution level, into at 
least two homogeneous regions, said given 
resolution level not being the highest resolution 
level in the decomposition. 

characterised in that it has: 

- means (62) of extracting contour data from the 
result of the segmentation of the previous step, 

- means (63) for the second segmentation of at 
least one sub-part of the resolution level higher 
than the given resolution level into at least one 
homogeneous region, as a function of the ex- 
tracted contour data. 



10. Analysis device according to Claim 9, characterised 
in that the decomposition means (60) are adapted 
to effect a decomposition which is, at each resolu- 
tion level, a decomposition into a plurality of fre- 
quency sub-bands. 



11 



Analysis device according to Claim 10, character- 
ised in that the first segmentation means (61) are 
adapted to effect a segmentation on one low-fre- 
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quency sub-band of the given resolution level. 

12. Analysis device according to any one of Claims 9 
to 11 , characterised in that the first segmentation 
means (61) are adapted to consider a given reso- 
lution level which is the lowest resolution level. 

13. Analysis device according to any one of Claims 9 
to 12. characterised in that the means of extraction 
(62) and second segmentation (63) are adapted to 
function iteratively as far as the highest resolution 
level. 

14. Analysis device according to any one of Claims 9 
to 13. characterised in that the second segmenta- 
tion means (63) are adapted to effect: 

a projection of a contour image resulting from 
the first segmentation, onto said at least one 
sub-part of the higher resolution level which is 
to be segmented, 

a marking of the coefficients of said at least one 
sub-part of the higher resolution level, as a 
function of the result of the projection, and 
a decision. 



18. Digital signal processing apparatus, characterised 
in that it has means adapted to implement the meth- 
od according to any one of Claims 1 to 8. 

5 19. Digital signal processing apparatus, characterised 
in that it includes the device according to any one 
of Claims 9 to 16. 

20. Storage medium storing a program for implement- 
io ing a method according to any one of claims 1 to 8. 

21. Storage medium according to claim 31 , character- 
ised in that said storage medium is detachably 
mountable on a device according to any one of 

*5 claims 9 to 17. 

22. Storage medium according to claim 21 , character- 
ised in that said storage medium is a floppy disk or 
a CD-ROM. 

20 



25 



15. Analysis device according to any one of Claims 10 
to 14, characterised in that the second segmenta- 
tion means (63) are adapted to effect a second seg- 
mentation on a low-frequency sub-band of the high- 30 
er resolution level. 



16. Analysis device according to any one of Claims 9 
to 1 5, characterised in that the contour data extrac- 
tion means (6 1 , 62) are adapted to effect the follow- 35 
ing operations, for each coefficient of the segment- 
ed sub-part: 



comparison of said coefficient with its neigh- 
bours, 40 
setting a contour coefficient corresponding to 
said coefficient to a first predetermined value if 
the coefficient is different from at least one of 
its neighbours, or to a second predetermined 
value if the coefficient is similar to all its neigh- 45 
bours. 

17. Analysis device (1 0) according to any one of Claims 
9 to 1 6. characterised in that the decomposition, ex- 
traction and first and second segmentation means so 
are incorporated in: 

a microprocessor (100), 
a read only memory (1 02) containing a program 
for processing the data, and 55 
a random access memory (103) containing reg- 
isters adapted to record variables modified dur- 
ing the running of said program. 
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